Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: restore original udf in the remote function test, use supported type in the test data #996

Merged
merged 9 commits into from
Oct 7, 2024

Conversation

chelsea-lin
Copy link
Contributor

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@chelsea-lin chelsea-lin requested review from a team as code owners September 17, 2024 21:00
@product-auto-label product-auto-label bot added the size: s Pull request size is small. label Sep 17, 2024
@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. label Sep 17, 2024
"index": [
idx.item() if hasattr(idx, "item") else idx for idx in row.index
],
"name": tuple(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

doesn't the existing test highlight a gap between pandas and BigFrames. I'm concerned that by changing the test we can make it pass but leave the original issue unaddressed

Copy link
Contributor

@shobsi shobsi Sep 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After discussing offline, we are now changing just the data in the tests. The remote function tests involved in this PR have custom udf that inspects the index data types. In pandas the index type can be numpy based (e.g. Int64) or non-numpy (e.g. int64). But in bigframes the types are always numpy based, so that is what we are going to use for these tests.

@product-auto-label product-auto-label bot added size: xs Pull request size is extra small. and removed size: s Pull request size is small. labels Sep 24, 2024
@product-auto-label product-auto-label bot added size: s Pull request size is small. and removed size: xs Pull request size is extra small. labels Sep 25, 2024
@shobsi shobsi changed the title test: fix test_df_apply_axis_1_complex by converting numpy value fix: use underlying numpy values in remote_function handler code Sep 25, 2024
@shobsi shobsi changed the title fix: use underlying numpy values in remote_function handler code test: restore original udf in the remote function test, use supported type in the test data Sep 27, 2024
@shobsi shobsi merged commit a70d683 into main Oct 7, 2024
23 checks passed
@shobsi shobsi deleted the main_chelsealin_remotetest branch October 7, 2024 20:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: s Pull request size is small.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants